Video rebroadcasting with multiplexed communications and display via smart mirrors

ABSTRACT

During a first time period and for a first user, a second user is automatically selected based on competitive data of the first user and competitive data of the second user, and a workout selection is sent to cause a video of a workout to be displayed during a second time period on a smart mirror of the first user and a smart mirror of the second user. During the second time period, a live stream of the first user exercising is displayed at the smart mirror of the second user, and a live stream of the second user exercising is received and displayed at the smart mirror of the first user. During the second time period, a performance score of the first user and a performance score of the second user is displayed at the smart mirrors of the first user and the second user.

CROSS-REFERENCE TO RELATED PATENT APPLICATIONS

This application is a divisional of U.S. patent application Ser. No.17/188,725, filed Mar. 1, 2021 and titled “Video Rebroadcasting withMultiplexed Communications and Display Via Smart Mirrors,” which claimsthe benefit of and priority to U.S. Provisional Application No.63/074,894, filed Sep. 4, 2020 and titled “Video Rebroadcasting withMultiplexed Communications and Display Via Smart Mirrors,” and whichclaims the benefit of and priority to U.S. Provisional Application No.63/144,047, filed Feb. 1, 2021 and titled “Video Rebroadcasting withMultiplexed Communications and Display Via Smart Mirrors, and SmartWeight Integration,” and this application also claims the benefit of andpriority to U.S. Provisional Application No. 63/074,894, filed Sep. 4,2020 and titled “Video Rebroadcasting with Multiplexed Communicationsand Display Via Smart Mirrors,” and this application also claims thebenefit of and priority to U.S. Provisional Application No. 63/144,047,filed Feb. 1, 2021 and titled “Video Rebroadcasting with MultiplexedCommunications and Display Via Smart Mirrors, and Smart WeightIntegration”; each of the foregoing is related to U.S. Pat. No.10,758,780, issued Sep. 1, 2020 and titled “Reflective Video DisplayApparatus for Interactive Training and Demonstration and Methods ofUsing Same,” and the entire contents of each of the foregoing areincorporated herein by reference in their entireties.

FIELD

The present disclosure relates to systems for interactive videodelivery, and more specifically, to multiplexed voice and visualcommunications facilitated by smart mirrors.

BACKGROUND

Exercise is an important part of maintaining an individual's health andwellbeing. For many people, exercising is an activity that typicallyinvolves going to a gymnasium where they partake in a workout guided byan instructor (e.g., a fitness instructor, a personal trainer). However,dedicating a regular period of time to exercise at a gym can be achallenging endeavor due to other commitments in one's daily life (e.g.,a person's job, family obligations). Oftentimes, a gym may be located atan inconvenient location and/or an instructor's availability is limitedto certain periods of time during the day, thus limiting a person'sability to attend a workout at the gym. This inconvenience may also bedetrimental to the instructor whose clientele may be restricted topeople who are able to attend their workout at the gym at the prescribedperiod of time.

SUMMARY

During a first time period and for a first user and at a compute deviceof the first user, a second user is automatically selected based oncompetitive data of the first user and competitive data of the seconduser. During the first time period and from the compute device of thefirst user to the compute device of the second user, a workout selectionis sent to cause a video of a workout to be displayed during a secondtime period on a smart mirror of the first user and a smart mirror ofthe second user. During the second time period after the first timeperiod and from the compute device of the first user to the computedevice of the second user, a live stream of the first user exercisingduring the display of the video of the workout and captured by a cameraof the smart mirror of the first user is sent, to cause the live streamof the first user to be displayed at the smart mirror of the second userduring the second time period. During the second time period and at thecompute device of the first user from the compute device of the seconduser, a live stream of the second user exercising during the display ofthe video of the workout and captured by a camera of the smart mirror ofthe second user during the second time period is received. During thesecond time period and at the smart mirror of the first user, the livestream of the second user is displayed. During the second time periodand at the smart mirror of the first user, a performance score of thefirst user and a performance score of the second user is displayed whilethe performance score of the first user and the performance score of thesecond user are also displayed during the second time period at thesmart mirror of the second user.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a smart mirror, in accordance with someembodiments.

FIG. 2A shows a first example implementation of a smart mirror, inaccordance with some embodiments.

FIG. 2B shows a second example implementation of a smart mirror, with anintegrated stand, in accordance with some embodiments.

FIG. 2C shows a third, wall-mountable example implementation of a smartmirror, in accordance with some embodiments.

FIG. 3A is an example flow diagram showing multiplexed communicationsduring a video rebroadcasting session, in accordance with someembodiments.

FIGS. 3B-3C show example display configuration for a videorebroadcasting session, in accordance with some embodiments.

FIG. 4 is a diagram showing an example locker room implementation, inaccordance with some embodiments.

FIG. 5 is a diagram showing interrelatedness of certain biometric dataparameters.

DETAILED DESCRIPTION

The demand for home fitness products has been increasing for years, andin the midst of widespread public health concerns arising from Covid-19,forcing many to self-quarantine, such demand, in particular for“interactive” home fitness products, has been further enhanced. Knownapproaches to interactive fitness, however, typically involve a userinteracting with a software application running on a smartphone, makingit difficult to coordinate movements with the ability to clearly viewthe instruction rendered via the smartphone screen. In addition, manyknown approaches to streaming fitness content (e.g., via smarttelevisions) are not interactive (i.e., they involve one-way delivery ofstreamable content to viewers), and can exhibit low and/or inconsistentvideo resolution/quality, bandwidth limitations, latency issues,reliability issues (e.g., video dropout) buffering delays, video streamstuttering, device incompatibilities, etc. Embodiments set forth hereinovercome the foregoing limitations of known approaches to deliveringfitness content in a variety of ways, as discussed in the sections thatfollow.

Smart Mirrors

A “smart mirror,” as used herein, refers to a two-way mirror (e.g.,comprising glass) and an electronic display that is at least partiallyaligned with (and disposed behind, from the point of view of a user) thetwo-way mirror, such that the user can simultaneously view his/her ownreflection and the imagery/video presented via the electronic displayduring operation of the smart mirror. FIG. 1 is a block diagram of asmart mirror 100, in accordance with some embodiments. The smart mirror100 includes a single board computer (SBC) 110 that controls, at leastin part, the operation of various subcomponents of the smart mirror 100and to manage the flow of content to/from the smart mirror 100 (e.g.,video content, audio from one or more instructors and/or users,biometric sensor data, etc.). The smart mirror 100 includes a displaypanel 120 configured to display video content and a graphical userinterface (GUI) with which users may interact to control the smartmirror 100, for example to view biometric feedback data and/or othervisual content, to select content for display, etc. The smart mirror 100also includes a camera 130 operably coupled to the SBC 110 andconfigured (e.g., under control of the SBC 110) to record or live streamvideo and/or images of a user (e.g., while the user is exercising duringa workout session). An antenna 140 is operably coupled to the SBC 110and configured to facilitate communications between the smart mirror 100and another device (e.g., a remote compute device, one or more othersmart mirrors, a remote control device, one or more biometric sensors, awireless router, one or more mobile compute devices, etc.) bytransmitting and receiving signals representing messages. The antenna140 can include multiple transmitters and receivers each configured totransmit/receive at a specific frequency and/or using a specificwireless standard (e.g., Bluetooth, 802.11a, 802.11b, 802.11g, 802.1 in,802.11 ac, 2G, 3G, 4G, 4G LTE, 5G). The antenna 140 may include multipleantennas that each function as a receiver and/or a transmitter tocommunicate with various external devices, such as a user's smart device(e.g., a computer, a smart phone, a tablet), a biometric sensor (e.g., aheart rate monitor, a vibration sensor, or any other sensor describedherein), and/or a remote server or cloud server to stream or play videocontent. An amplifier 150 is operably coupled to the SBC 110, a leftspeaker 152, a right speaker 154, and a microphone array with a digitalsignal processor 160, The amplifier 150 is configured to receive audiosignals from the SBC 110 and route them for subsequent output throughthe left speaker 152 and/or the right speaker 154. The microphone array160 can be configured to detect audio/voice, including voice commandsand/or other voice inputs made by one or more users within sufficientproximity of the smart mirror 100. For example, the microphone array 160can detect voice commands to start/stop a workout, voice communicationsto the instructor, voice commands to turn the display panel on/off,voice commands to change a layout of the GUI, voice commands to triggeran invitation to another smart mirror user to participate in a workoutsession, etc. The microphone array 160 is operably coupled to, andcontrollable by, the SBC 110. A switched-mode power supply (SMPS) 170 iscoupled to the SBC 110 and coupled to relay (and, optionally, regulatedelivery of) electrical power from an external electrical power supplysystem (e.g., a wall outlet) to the various components of the smartmirror 100. A switch 180 may be coupled to the SMIPS 170 and/or themicrophone array 160 to switch the smart mirror 100 and the microphonearray 160 on and off. Although shown and described in FIG. 1 asincluding a single board computer 110, in other embodiments the smartmirror 100 can include one or multiple processors and one or multiplememories operably coupled to the one or multiple processors.

In some embodiments, the smart mirror 100 also includes one or moreadditional components not shown in FIG. 1 . For example, the smartmirror 100 may include onboard memory storage (nonvolatile memory and/orvolatile memory) including, but not limited to, a hard disk drive (HDD),a solid state drive (SDD), flash memory, random access memory (RAM), ora secure digital (SD) card. This onboard memory storage may be used tostore firmware and/or software for the operation of the smart mirror100. As described above, the onboard memory storage may also be used tostore (temporarily and/or permanently) other data including, but notlimited to, video content, audio, video of the user, biometric feedbackdata, and user settings. The smart mirror 100 may also include a frameto mount and support the various components of the smart mirror 100.

Smart mirrors of the present disclosure may be positioned or mountedwithin an environment (e.g., a user's home, a fitness studio) in avariety of ways. FIG. 2A shows a first example implementation of a smartmirror, in accordance with some embodiments. FIG. 2B shows a secondexample implementation of a freestanding smart mirror, with anintegrated stand, in accordance with some embodiments. FIG. 2C shows athird, wall-mountable example implementation of a smart mirror, inaccordance with some embodiments. FIGS. 2A and 2B show the smart mirrormounted to a stand positioned at the bottom of the smart mirror. As canbe seen in FIG. 2A, the smart mirror reflects (via a semi-reflective orpartially reflecting surface thereof) an image of a user (here, taking apicture of the smart mirror with a smart phone) and the surroundingenvironment. The smart mirror of FIG. 2A also displays video contentthrough the semi-reflective or partially reflecting surface, such thatthe video content and the reflections of the user and the surroundingenvironment are concurrently viewable via the smart mirror. When thesmart mirror is powered off, the smart mirror has a fully reflectiveappearance under ambient lighting. In some implementations, the smartmirror includes a partially reflecting section and a fully reflectingsection (e.g., surrounding the partially reflecting section).

Video Rebroadcasting Sessions with Multiplexed Smart MirrorCommunications (“Sweat Dates”)

In some embodiments, a previously-recorded (“archived”) video includingfitness content is made available (e.g., via a cloud-based server) to,or is accessible by, a networked plurality of smart mirrors. Thepreviously-recorded video can be a previously-aired or previouslybroadcast class from a library of classes stored in the cloud-basedserver or other storage repository. The previously-recorded video mayhave been captured “live” via a smart mirror camera, or may have beenrecorded offline (e.g., in a fitness recording studio). One or moreusers (“scheduler(s)”) of the smart mirrors can schedule a broadcastingor rebroadcasting “session” (hereinafter “video rebroadcasting session”)of the previously-recorded video during a specified time interval, andinvite other smart mirror users from a selected group of other smartmirror users (invitees) to join the session and watch thebroadcast/rebroadcast simultaneously during the specified time interval.By interacting with a software application (“app”) running on a mobiledevice (e.g., a smartphone) and/or a smart mirror, the scheduler(s) canspecify one or more of the following parameters for the videorebroadcasting session (“session data”): a start date, a start time, anend date, an end time, identifiers of user(s) that are invited toparticipate in the video rebroadcasting session (“invitees”), overlaysto be presented to the invitees during the video rebroadcasting session,etc. The invitees can include all subscribers or users of smart mirrorswithin a networked community of smart mirrors, or a subset thereof. Insome implementations, non-invitee smart mirror users are blocked fromjoining the video rebroadcasting session (e.g., by setting a “rule” thatis stored in the cloud-based server or another repository accessible byand used by the app).

During the video rebroadcasting session, the scheduler and the inviteesposition themselves near their respective smart mirrors and view thepreviously-recorded video, which is displayed concurrently on the smartmirrors of all invitees, while simultaneously viewing “live” (i.e.,real-time or substantially real-time) video of themselves and,optionally, the scheduler and/or one or more other invitees. Also duringthe video rebroadcasting session, the scheduler and the invitee(s) caninteract with one another via their respective smart mirrors, e.g.,visually (e.g., by gesturing within the field of view of the cameras oftheir respective smart mirrors, the gestures being viewable via thesmart mirror(s) or one or more invitees), images (e.g., causing displayof photos/images on smart mirrors of one or more invitees), voice (e.g.,via the microphone(s) and speaker(s) of their respective smart mirrors),and/or by inputting feedback via the app (e.g., via a graphical userinterface (GUI) of the app running on their smart mirror and/or via aGUI of the app running on their smartphone). As such, the smart mirrors,the scheduler, and the invitees (some or all of which are geographicallyremote from one another), as well as their communications with oneanother, are multiplexed within a networked system (e.g., as shown anddiscussed with reference to FIG. 3A, below). The feedback can includetext and/or graphic symbols (e.g., emojis) that is subsequentlydisplayed via the app of one or more invitees (e.g., via a GUI of theapp running on their smart mirror and/or via a GUI of the app running ontheir smartphone). The disclosed system therefore facilitatesmultiplexed communications between and among the scheduler and theinvitees, who may be geographically remote from one another. Optionally,real-time biometric data of the scheduler and/or the invitees can bedisplayed via a smart mirror of the scheduler and/or the invitees.

FIG. 3A is an example flow diagram showing multiplexed communicationsassociated with scheduling and hosting a video rebroadcasting session,in accordance with some embodiments. As shown in FIG. 3A, each ofmultiple smart mirrors (300A, 300B, 300C and 300D) and an optionalstudio compute device 301 can communicate with a centralized server 310(e.g., a cloud-based server including a processor and a memory storingprocessor-executable instructions to perform method steps describedherein) via a network “N.” The network N can be a fully wirelesstelecommunications network, a fully wired telecommunications network, ora combination of both. The studio compute device 301 can be a desktopcomputer, laptop computer, tablet and/or smartphone, and can be locatedin a recording studio or other location suitable for recording video andaudio for live and/or subsequent broadcast. The smart mirrors 300A,300B, 300C and 300D can be similar to, or include some or all of thecomponents of, the smart mirror 100 of FIG. 1 . As shown in FIG. 3A,each of the smart mirrors 300A, 300B, 300C and 300D includes a processor302, communications component(s) 303 (e.g., one or more antennas,transceivers, etc.), a memory 304, a video camera 305, and at least onemicrophone (e.g., a microphone array) 307. Each memory 304 stores aninstance of a shared software application (“app” 304A), settings 304B(e.g., user-customizable settings for that smart mirror), session data304C (e.g., including data associated with past video rebroadcastingsessions and/or future video rebroadcasting sessions), user profile data304D for the user(s) associated with that smart mirror, and optionally afeedback archive 304E and/or account data and permissions 304F. Thestudio compute device 301 includes a processor 302, communicationscomponent(s) 303 (e.g., one or more antennas, transceivers, etc.), amemory 304, a video camera 305, and at least one microphone (e.g., amicrophone array) 307. The memory 304 of the studio compute device 301stores session data 304C, video(s) 315, and, optionally, an instance ofthe shared software application (“app” 304A). The session data 304C caninclude, for example, one or more of: class name(s), instructor name(s),original recording date, original recording time, number of timesrebroadcast (i.e., number of previous video rebroadcasting sessionsand/or future video rebroadcasting sessions), scheduled futurerebroadcast date(s), scheduled future rebroadcast time(s), scheduledfuture rebroadcast duration(s), scheduled future rebroadcastparticipants/invitees, scheduled future rebroadcast scheduler(s), etc.In some implementations, the studio compute device 301 is a smartmirror.

According to some embodiments, prior to scheduling a videorebroadcasting session, one or more videos 315 (optionally recorded viathe camera 305 of the studio compute device by an instructor user of thestudio compute device 301) are sent to the server 310, via the networkN, from the studio compute device 301. The one or more videos 315 can bestored in a memory of the server 310 for later retrieval by one or moreusers of the smart mirrors 300A, 300B, 300C and 300D. The users of thesmart mirrors 300A, 300B, 300C and 300D can also browse the one or morevideos 315 stored in the memory of the server 310 via the shared app 304on their respective smart mirrors and/or via instances of the shared app304 running on their respective smart phones or other mobile computedevice(s). Although the one or more videos 315 are shown and described,with reference to FIG. 3A, as being sent to the server 310 from (andoptionally recorded via) the studio compute device 301, alternatively orin addition, the one or more videos 315 can be sent to the server 310from (and optionally recorded via) one or more of the smart mirrors300A-300D. In such embodiments, the one or more videos can features theuser(s) (e.g., performing workouts) rather than an instructor.

As shown in FIG. 3A, the scheduling of a video rebroadcasting sessionbegins with a session request 320 sent from one of the networked smartmirrors (in this case, smart mirror 300B), via the network N, to theserver 310. The session request 320 can be generated and sent inresponse to an input or interaction of a user of the smart mirror 300Bvia the shared app 304 running on the smart mirror 300B and/or via aninstance of the shared app 304 running on the smart phone or othermobile compute device of the user. A user (or a smart mirror associatedwith that user) that causes generation of a session request 320 can bereferred to as a “scheduler.” The session request 320 can include one ormore video identifiers associated with the videos 315, one or more useridentifiers associated with the scheduler(s), and/or representations ofone or more: class names, instructor names, original recording dates,original recording times, number of times rebroadcast (i.e., number ofprevious video rebroadcasting sessions and/or future videorebroadcasting sessions), skill levels, muscle groups, requested futurerebroadcast date(s), requested future rebroadcast time(s), requestedfuture rebroadcast duration(s), requested future rebroadcastparticipants/invitees, etc. The server 310 can maintain a local calendaror other schedule of past, current and/or future video broadcasts andrebroadcasts. The server 310, upon receiving (and in response to) thesession request 320, can compare data from the session request with datastored in the memory of the server 310 to determine whether therequested video rebroadcasting session can be scheduled. If so, theserver 310 may store, in the calendar or other schedule, a new datarecord associated with the video rebroadcasting session. Also inresponse to receiving the session request, the server 310 generates andsends, to the smart mirror 300B and via the network N, a sessionacknowledgment message 322. The session acknowledgment message 322 caninclude an indication as to whether the video rebroadcasting session hasbeen approved/scheduled, a confirmation number for the request and/oracknowledgment, and if scheduled, scheduling information. Optionally, ifa requested video rebroadcasting session has not been scheduled, or hasbeen disapproved, the session acknowledgment message 322 can includesuggestions for alternative scheduling, e.g., including any of the datatypes included in the session request.

If the smart mirror 300B receives a session acknowledgment message 322indicating that the video rebroadcasting session has not been scheduled,one or more session requests 320 may be sent from the smart mirror 300Bto the server 310, in response to one or more of: a user selection ofnew session details made via the shared app, a user selection of asuggested alternative scheduling made via the shared app, or anautomatic instruction generated by the smart mirror 300B based on a rulewithin the settings 304B of the smart mirror 300B.

If the session acknowledgment message 322 indicates that the videorebroadcasting session has been scheduled, the server 310 (and/or thesmart mirror 300B or a mobile device operably coupled thereto) can send,either subsequently to or concurrently with sending the sessionacknowledgment message 322, invitation messages to smart mirrorsassociated with users that are invited to the scheduled videorebroadcasting session (e.g., as specified by the session request 320).In this case, invitations 324A, 324B and 324C are sent to smart mirrors300A, 300C and 300D, respectively. Once received at the respective smartmirrors, the invitations can trigger the display, via the shared app304A of the smart mirrors and/or via the shared app 304A of mobiledevices (optionally operably coupled to the smart mirrors), auser-selectable option to accept an invitation to join the scheduledvideo rebroadcasting session. Response messages 325A, 325B and 325C aregenerated based on the users' selections, and sent back to the server310 which, in turn, can update the new data record associated with thevideo rebroadcasting session, to indicate a participation status (e.g.,“accepted” or “declined”) for each of the users and/or smart mirrors. Atthe scheduled session start time, the server 310 can initiate andtransmit a session feed (e.g., session feeds 326A, 326B, 326C and/or326D), or a streamed version of the video(s) associated with the one ormore video identifiers of the session request, to each smart mirrorassociated with an “accepted” participation status. Note that in someimplementations, the scheduler(s) is automatically assigned an“accepted” participation status and sent the session feed during thevideo rebroadcasting session, while in other implementations thescheduler(s) is not automatically assigned an “accepted” participationstatus and/or the session request 320 includes a representation of aparticipation status for the scheduler(s). During the videorebroadcasting session, the session feeds 326A, 326B, 326C and/or 326Dcause display of the video(s) associated with the one or more videoidentifiers of the session request via the associated smart mirrors300A, 300C, 300D and/or 300B. Also during the video rebroadcastingsession, users of the smart mirrors 300A, 300C, 300D and/or 300B cansend feedback (328A, 328B, 328C and/or 328D, respectively) to the smartmirror(s) of one or more other invitees, optionally subject to settings304B and/or permissions 304F of the smart mirror(s) of one or more otherinvitees. The feedback can include text, images, graphics (e.g.,emojis), voice and/or video that is displayed or otherwise delivered viathe smart mirror(s) (and/or associated mobile device(s)) of therecipient(s). Optionally, feedback that is sent or exchanged during thevideo rebroadcasting session is stored in the feedback archive(s) 304Eby the smart mirror(s) of one or more smart mirrors (300A, 300C and/or300D) of the invitees. The feedback can be stored in the feedbackarchive(s) 304E in the form of records that include feedback date/timedata, sender data, recipient data, session data and/or other dataassociated with the feedback, such that the feedback can subsequently beretrieved, viewed and/or displayed. The sender data can include senderidentifier(s), sender biometric data, sender location data, senderfitness level data, etc. Similarly, the recipient data can includerecipient identifier(s), recipient biometric data, recipient locationdata, recipient fitness level data, etc.

FIGS. 3B-3C show example display configuration for a videorebroadcasting session, in accordance with some embodiments. In a firstembodiment, shown in FIG. 3B, while a session feed 326A-326D is beingtransmitted/fed to the smart mirrors 300A-300D during the videorebroadcasting session described with reference to FIG. 3A, a user “U”of a given smart mirror (e.g., smart mirror 300B) can view, concurrentlyand in/on a common surface of the smart mirror: (1) a reflection ofhimself/herself (“U”), (2) the video feed showing the pre-recorded video(e.g., including an instructor “INST”), and optionally (3) live video ofone or more other invitees (here, “INV-1” through “INV-3”), captured bythe smart mirrors (300A, 300C and/or 300D) of those invitees. As shownin FIG. 3B, the invitees can be presented in discrete panes arrangedwithin the display of the common surface of the smart mirror. The panescan be arranged in a horizontal row along a smaller of a height or widthof the smart mirror (as shown in FIG. 3B), or alternatively in ahorizontal row along a larger of the height or width of the smartmirror, in a vertical row along a smaller of the height or width of thesmart mirror, in a vertical row along a larger of the height or width ofthe smart mirror, or in any other (optionally user-specified and/orreconfigurable) configuration. Optionally, the smart mirror hastouch-screen functionality, such that user “U” can select (by touchingthe image of) one of the other invitees “INV-1” through “INV-3” to causethe associated live video pane to be resized (e.g., enlarged, reduced)within the smart mirror display, to close (i.e., stop display of) theassociated live video pane, etc. Alternatively or in addition, the userU can view some or all components of the video rebroadcasting sessionvia an instance of the shared app on his/her mobile compute device andinteract with the video panes using the associated GUI of the mobilecompute device, such that the video panes are resized or closed on thesmart mirror. In other words, in response to a user manipulation of avideo pane in a GUI of his/her mobile compute device, the shared app cancause the smart mirror to adjust the way that the video pane is renderedon the smart mirror.

In a second embodiment, shown in FIG. 3C, while a session feed 326A-326Dis being transmitted/fed to the smart mirrors 300A-300D during the videorebroadcasting session described with reference to FIG. 3A, a user “U”of a given smart mirror (e.g., smart mirror 300B) can view, concurrentlyand in/on a common surface of the smart mirror that may be oriented in a“landscape” format (i.e., the width is larger than the height): (1) areflection of himself/herself (“U”), (2) the video feed showing thepre-recorded video (e.g., including an instructor “INST”), andoptionally (3) live video of one or more other invitees (here, “INV-1”through “INV-3”), captured by the smart mirrors (300A, 300C and/or 300D)of those invitees. As shown in FIG. 3C, the live video images of theinvitees can be presented within the common surface of the smart mirror(not in panes) and arranged (e.g., dimensioned) such that the inviteesare similar in size to, or at least 50% the size of, the size of thereflected image of user U, thereby simulating a live “class”environment. As also shown in FIG. 3C, one or more “guest” users may besufficiently permissioned (or request permission in realtime) to join anongoing video rebroadcasting session, and may be labelled as such withinthe smart mirror display. Similar to the embodiment of FIG. 3B, thesmart mirror optionally has touch-screen functionality, such that user“U” can select (by touching the image of) one of the other invitees“INV-1” through “INV-3” to cause the associated live video to be resized(e.g., enlarged, reduced) within the smart mirror display, to close(i.e., stop display of) the associated live video, etc. Alternatively orin addition, the user U can view some or all components of the videorebroadcasting session via an instance of the shared app on his/hermobile compute device and interact with the live video of the inviteesusing the associated GUI of the mobile compute device, such that thelive video images are resized or closed on the smart mirror. In otherwords, in response to a user manipulation of a live video image in a GUIof his/her mobile compute device, the shared app can cause the smartmirror to adjust the way that the live video is rendered on the smartmirror.

Camera Activation in Mirror Device

In some embodiments, a live video/camera feed of a first smart mirror(e.g., smart mirror 100 of FIG. 1 ) from a networked plurality of smartmirrors (e.g., smart mirrors 300A-300D of FIG. 3A) is transmitted (as a“live stream”) to one or multiple other smart mirrors from the networkedplurality of smart mirrors, for example via a wired or wireless network(e.g., network N of FIG. 3A) and via a server (e.g., server 310 of FIG.3A). The live streaming can be selectively turned on and off by the userof the first smart mirror and/or by the users of the one or multipleother smart mirrors from the networked plurality of smart mirrors, forexample, according to permissions. The action of turning on or off thelive stream can be in response to one or more of: an interaction by auser with an instance of a shared app on the smart mirror, aninteraction by a user with an instance of a shared app on a mobilecompute device, a voice/nose command made by a user via an instance of ashared app on the smart mirror, a voice/noise command made by a user viaan instance of a shared app on a mobile compute device, a gesturecommand made by a user via an instance of a shared app on the smartmirror, a gesture command made by a user via an instance of a shared appon a mobile compute device, etc. The live stream can be captured by oneor more smart mirrors from the streaming feed to produce captured video,and the captured video can be modified post-capture to remove and/or toadd graphical elements, thereby producing modified captured video. Thegraphical elements can be images or animations that modify the user orthe environment around the user (e.g. obscuring a user's background,modifying a user's appearance, overlaying one or more filters, and/oradding one or more dynamic effects (e.g., an augmented reality (AR)feature such as a pet or a crackling fire)). The captured video and/orthe modified captured video can be sent from the smart mirror(s) to aremote server (e.g., a cloud server, such as server 310 in FIG. 3A), forexample for subsequent retrieval, rebroadcast, etc.

Encouragement Messaging:

In some embodiments, during a workout session, a video rebroadcastingsession, and/or a “locker room” session (discussed further below), smartmirror users can cause the display of encouragement messages (e.g.,including text, images, video, graphics (e.g., emojis), gestures, voice,animation, etc.) to be displayed in the smart mirrors and/or mobilecompute devices (e.g., via a GUI of a shared app running thereon) ofother smart mirror users within a networked plurality of smart mirrors.The encouragement messages can be generated and sent from a sendercompute device (e.g., smart mirror, app, or smartphone) in response toan input or interaction of a user of a given smart mirror via a sharedapp running on that smart mirror and/or via an instance of the sharedapp 304 running on a smart phone or other mobile compute device of theuser. Encouragement messages can be sent between individual users (i.e.,one-to-one), for example between workout session participants and/orbetween an instructor and a workout session participant, or from asingle user to multiple users, up to the entire community of users(i.e., one-to-many). Encouragement messages can be stored in memory,e.g., in the form of records that include feedback date/time data,sender data, recipient data, session data, workout data, maliciousnessscore(s), offensiveness score(s), sentiment score(s), and/or other dataassociated with the encouragement messages, such that the encouragementmessages can subsequently be retrieved, viewed and/or displayed. Theencouragement messages can be stored automatically, according to auser-defined rule, and/or in response to a user request. Theencouragement messages can be stored in a memory of one or more smartmirrors, one or more remote servers (e.g., cloud servers), and/or one ormore mobile compute devices.

Encouragement messages, once received at smart mirrors and/or mobilecompute devices, may first be inspected, and a determination may be madeas to whether the sender, a smart mirror or mobile compute device of thesender (i.e., a sender device), and/or the message contents aresufficiently permissioned or have previously been “whitelisted” suchthat they may be delivered or presented to the intended recipient. Forexample, the smart mirror and/or mobile compute device, via a processorthereof and/or via a shared app, can perform one or more of thefollowing inspections/checks: analyze the message contents to determinea maliciousness score, analyze the message contents to determine anoffensiveness score, analyze the message contents to determine asentiment score, evaluate the message contents based on a set of rulesor permissions, compare a sender identifier to stored sender data todetermine whether the associated sender has been whitelisted,blacklisted, or has one or more associated permissions, compare a senderdevice identifier to stored device data to determine whether theassociated sender device has been whitelisted, blacklisted, or has oneor more associated permissions, etc. After the inspections/checks havebeen performed, the smart mirror and/or mobile compute device, via aprocessor thereof and/or via a shared app, can perform one or more ofthe following remediation actions: block delivery of the encouragementmessage to the recipient (e.g., prevent display of the encouragementmessage), send a reply message to the sender to indicate that theencouragement message has not been delivered, etc. The remediationactions can be performed in response to one or more triggers, which caninclude, but are not limited to: a maliciousness score exceeding apredefined, user-customizable threshold, detecting that the sender ishas been blacklisted, detecting that the sender device has beenblacklisted, detecting a rule that prevents delivery of messages fromthe sender, detecting a rule that prevents delivery of messages from thesender device, detecting a rule that prevents delivery of messagescontaining one or more predefined, user-customizable keywords, detectinga rule that prevents delivery of messages containing profanity, etc.

As used herein, a maliciousness score can be a numerical score that isgenerated using a machine learning algorithm configured to detectmalware, spyware, spam and other unwanted messages. As used herein, anoffensiveness score can refer to a numerical score that is generatedbased on one or more of: a linguistic model, one or more previousratings assigned by the intended recipient user, a user-customizablesensitivity score associated with the intended recipient user, etc. Asused herein, a sentiment score can refer to a numerical score (includingpositive values and negative values) generated by a machine learningmodel, the numerical score representing an overall sentiment or tone(e.g., angry, menacing, passive-aggressive, sarcastic, encouraging,happy, etc.) of an input message.

In some embodiments, encouragement messages are sent after asender-specified time delay or at a sender-specified scheduled date/timeor period (e.g., during a class scheduled for the next day).Alternatively or in addition, the display of encouragement messagesreceived at a smart mirror (or app thereof) of a recipient may bedelayed by, or blocked for, a recipient-defined period of time or untila user-defined event occurs or has transpired (e.g., after class toavoid distraction).

In some embodiments, encouragement messages are sent automatically to afirst smart mirror (e.g., from a server and/or from one or more othersmart mirrors), in response to detecting that one or more predefinedconditions have been meet and/or that one or more rules have beensatisfied. Examples of rules can include, but are not limited to: a ruleto send encouragement messages to recipients that are friends and thatthat have set a new record within a predetermined preceding time period;a rule to send an encouragement message to a recipient in response todetecting that a performance metric (e.g., heart rate, intensity,breathing rate, cadence, power, etc.) of the recipient has reduced by atleast a predetermined percentage within a predetermined period of time;a rule to send an encouragement message to a recipient in response todetecting that a workout session in which the recipient is participatingis within a predetermined of time of an end time of the workout session(e.g., nearing the end of the workout session or a high-intensityportion thereof), a rule to randomly send encouragement messages (e.g.,the timing, recipient and/or contents of the encouragement messages canbe randomly selected), etc. Examples of conditions can include, but arenot limited to: the existence of a friend relationship between thesender and the receiver; the existence of one or multiple social mediaconnections between the sender and the receiver; fewer than apredetermined number of encouragement messages sent within a precedingpredetermined period of time, etc.

In some embodiments, encouragement messages can be configured to“persist” within a GUI of the recipient (e.g., in the smart mirror ofthe recipient and/or in a smartphone or other mobile device of therecipient). As used herein, “persist” can refer to the continuousdisplay for a predetermined extended period of time (e.g., greater thanone minute, greater than five minutes, greater than ten minutes, for theduration of a workout session, until the smart mirror is turned off, orindefinitely) and/or until closed or minimized by the recipient. Forexample, in some such embodiments, an encouragement message isconfigured to display as a banner having at least one dimension that isthe same as a width or a height of the smart mirror and/or having atleast one dimension that is the same as a width or a height of thedisplay panel of the smart mirror. In some such implementations, anencouragement message (e.g., in the form of a banner) persists within aportion of a display panel of a smart mirror when the remainder of thedisplay panel is no longer displaying video (i.e., the remainder of thedisplay panel has a mirror appearance).

In some embodiments, a smart mirror (or an app thereof) is configured toconvert one or more encouragement messages, received from a sender froma first, as-received format, to a user-defined (i.e., recipient-defined)format that is different from the as-received format, either based onone or more rules stored in memory or based on an input received at thesmart mirror and/or via the app from the user/recipient. Examples ofas-received formats and user-defined formats include, but are notlimited to: text, image, bitmap (e.g., Graphics Interchange Format(“GIF”)), animated GIF, video, audio, haptic/vibration feedback, AdobeFlash, watermark, etc. In some such embodiments, the rules stored inmemory and/or the input from the user/recipient include instructions topresent the encouragement messages using one of a display panel or aspeaker of the smart mirror, or to cause communication of theencouragement messages to a recipient using an antenna of the smartmirror (e.g., by transmitting a signal to one or more compute devices,apps, or smart accessories in network communication with the smartmirror).

As a first example, a received encouragement message including a visualhand clap emoji can be converted to an audio hand clap that is playedvia the left speaker and/or the right speaker of the smart mirror. As asecond example, a received encouragement message including a textmessage can be converted to a graphic image that is displayed via thedisplay panel of the smart mirror. As a third example, a receivedencouragement message including an audio file (e.g., including arepresentation of speech or of sounds such as clapping) can be convertedto text that is displayed via the display panel of the smart mirror. Asa fourth example, a received encouragement message including image datacan be converted to a GIF that is displayed via the display panel of thesmart mirror. As a fifth example, a received encouragement messageincluding graphic image data (e.g., an emoji) can be converted to asignal that is sent, via an antenna of the smart mirror, to an apprunning on a smart phone of the recipient, to cause display of areduced-size image based on the graphic image data. As a sixth example,a received encouragement message including a text message can beconverted to a signal that is sent, via an antenna of the smart mirror,to a wearable electronic accessory of the recipient (e.g., a bracelet)to cause a vibration (e.g., in a predefined pattern, with a predefinedintensity, etc.) of the wearable electronic accessory. As a seventhexample, a received encouragement message including a text message canbe converted to a log file that is stored within a memory of the smartmirror (or in a remote server communicatively coupled to the smartmirror), for later retrieval/viewing. As an eighth example, a receivedencouragement message including a text image and/or image file can beconverted into a social media post that is sent, via an app, for postingon one or multiple social media platforms (e.g., according to one ormore predefined rules, which may specify privacy settings, post timing,automatic caption generation, rules for tagging other social mediausers, etc.).

In some embodiments, the smart mirror, app and/or mobile compute deviceassociated with the smart mirror is configured to automatically generateand send a reply message (e.g., including another encouragement message,acknowledging receipt of the encouragement message, expressing gratitudefor the encouragement message, etc.) to the sender compute deviceassociated with the encouragement message.

In some embodiments, the smart mirror, app and/or mobile compute devicestores rules or filters configured to block delivery, display, orpresentation of an encouragement message in response to determining thata sentiment score, calculated for the encouragement message, isassociated with an overall sentiment or tone of for example angry,menacing, passive-aggressive, or sarcastic.

In some embodiments, a smart mirror, app and/or mobile compute devicecan store rules or filters configured to block sending, delivery,display, or presentation of an encouragement message in response todetecting one or more predefined recipient conditions, which may include(but are not limited to): poor performance in a workout (e.g., aperformance metric, optionally correlated to one or more biometric datavalues, such as speed, range of motion, muscle activation, etc. beingbelow a predefined threshold value), injury (e.g., during a workout),distress, heart rate above a predefined threshold, etc. The one or morepredefined recipient conditions can be detected based on live video dataassociated with the recipient (e.g., gathered via the smart mirrorand/or the mobile compute device), sensor data gathered by one or morewearable electronic accessories (e.g., received at the smart mirrorand/or the mobile compute device), etc.

In some embodiments, an instructor provides input to his/her smartmirror and/or mobile compute device (e.g., via voice, video gesturing,touch interaction with a graphical user interface, etc.) to causedisplay, within a display panel or GUI of a plurality of smart mirrorsand/or mobile compute devices of a subset of workout participants, arequest or suggestion for the subset of workout participants to sendencouragement messages to at least one other workout participant notincluded in the subset of workout participants.

In some embodiments, encouragement messages received for a givenrecipient user of a smart mirror can be stored (e.g., in memory of thesmart mirror and/or in a memory of a cloud server or other remotecompute device communicably coupled with the smart mirror, app and/ormobile compute device of the user), as “encouragement data,” and trackedover time. The encouragement data can be compared to other real-timeand/or stored data associated with the user, such as sensor data,workout performance data, workout data (e.g., type, intensity,instructor, number of participants, targeted muscle groups, etc.),social media data, biometric data, etc. to determine the effectivenessof the (historical) encouragement messages. Based on the determinedeffectiveness of the historical encouragement messages, the smart mirrorand/or app (optionally using one or more artificial intelligence (AI)(e.g., machine learning) algorithms) can determine encouragement messagetypes and/or encouragement message delivery timing that are deemed to bemost effective in helping/encouraging the recipient user.

Challenge (“Face-Off”) Workouts

In some embodiments, a first user of a first smart mirror in a firstlocation can send a “challenge” request (e.g., by interacting with a GUIof the first smart mirror or by interacting with a GUI of a first mobilecompute device of the first user) to a second user of a second smartmirror in a second location (the second smart mirror being differentfrom the first smart mirror and the first location being different fromthe second location). The challenge request is then displayed via a GUIof the second smart mirror (and/or via a GUI of a second mobile computedevice of the second user), and the second user can accept or deny thechallenge request via the same GUI(s). If the second user denies thechallenge request, a “denied” response is sent back to the first smartmirror and/or the first mobile compute device. If the second useraccepts the challenge request, an “accepted” response is sent back tothe first smart mirror and/or the first mobile compute device, and achallenge workout (e.g., selected by the first user, as part of thechallenge request generation) is simultaneously or substantiallysimultaneously displayed via both the first smart mirror and the secondsmart mirror, optionally at a mutually agreed later time.

During the challenge workout, video of the first user, obtained via oneor more video cameras of the first smart mirror and/or via camera(s) ofthe first mobile compute device, and/or audio of the first user,obtained via one or more microphones of the first smart mirror and/orvia microphone(s) first mobile compute device, are live streamed to thesecond smart mirror and displayed via the display panel of the secondsmart mirror. Similarly, during the challenge workout, video of thesecond user, obtained via one or more video cameras of the second smartmirror, and/or audio of the second user, obtained via one or moremicrophones of the second smart mirror, are live streamed to the firstsmart mirror and displayed via the display panel of the first smartmirror. As such, during the challenge workout, the first user and thesecond user can see themselves and their challenger (i.e., the otheruser) in their respective smart mirrors. In some embodiments, thechallenge workout can include audio and/or video of one or moreinstructors, which can be live and/or pre-recorded. For example, the oneor more instructors can direct the challenge workout between the firstuser and the second user. Also during the workout, each of the firstsmart mirror and the second smart mirror (e.g., via the app running onthe smart mirror) can: analyze and/or record video of the first user,analyze and/or record video of the second user, receive (and,optionally, analyze) biometric data (e.g., measurements and/orcalculations related to human characteristics) from one or more wearableelectronic accessories of the first user, and/or receive (and,optionally, analyze) biometric data from one or more wearable electronicaccessories of the second user, to determine scores (referred to hereinas, for example, “workout challenge scores” and “performance scores”)for the first user and the second user, and to identify a winner of thechallenge workout based on the scores. In addition and/or alternatively,during the workout, each of the first smart mirror and the second smartmirror can receive (and, optionally, analyze) data from one or moresmart/connected non-wearable electronic accessories of the first user(e.g., smart or connected weights), and/or receive (and, optionally,analyze) data from one or more non-wearable electronic accessories ofthe second user; such data can be, for example, measurements and/orcalculations related to movements of the user with the non-wearableelectronic accessory and/or characteristics of the non-wearableelectronic accessory such as the location, movement, weight, type,make/model and/or serial number of the electronic accessory. In someembodiments, the scores can include numeric values that are associatedwith, or calculated based on, the biometric data, but that do notinclude the biometric data itself. For example, a heartrate within afirst range may be assigned a score of “1,” whereas a heartrate within asecond range may be assigned a score of “2.” In other embodiments, thescores can include non-numeric values (e.g., letters, characters,symbols, graphics, images, etc.). For example, a breathing rate within afirst range may be assigned a score of “A,” whereas a breathing ratewithin a second range may be assigned a score of “B.” In someembodiments, an indication of a current score, a previous score, or atotal score (e.g., from current and previous scores) can be displayed inthe display panel of the smart mirror (e.g., within or overlaid on thevideo of the user). In some embodiments, an indication of a currentscore, a previous score, and/or a total score can be stored and/orencoded in the memory of the mirror (e.g., as a file in memory, or asmetadata of a recorded video file). The winner of the challenge workoutcan be displayed (as text, image(s) and/or audio output) via a GUI ofthe first smart mirror (and/or the first mobile compute device),displayed (as text, image(s), video(s), animation(s) and/or audiooutput) via the second smart mirror (and/or the first mobile computedevice), and saved in at least one memory (e.g., of the first smartmirror, the second smart mirror, a cloud-based server or other remoteserver, etc.) for later retrieval and viewing.

In other embodiments, a first user and a second user of a common(single) smart mirror in a common (single) location can select achallenge workout (e.g., by interacting with a GUI of the smart mirror,by interacting with a GUI of a first mobile compute device of the firstuser, or by interacting with a GUI of a second mobile compute device ofthe second user). In response to selecting the challenge workout, thesmart mirror displays a challenge workout (e.g., selected by the firstuser and/or the second user, as part of the challenge workoutselection). During the challenge workout, live video of the first userand the second user, obtained via one or more video cameras of the smartmirror, is displayed via the smart mirror display panel. The challengeworkout can be similar to the challenge workout for users using separatesmart mirrors (as described above), except that the challenge workout isviewed by both the first user and the second user on the common smartmirror. For example, video and/or audio of both the first user and thesecond user can be displayed via the display panel of the common smartmirror. Similar to challenge workouts for users on separate mirrors, thecommon smart mirror can (via the app) analyze and/or record video of thefirst user and the second user, either collectively (e.g., video of boththe first user and the second user simultaneously) or independently(e.g., the video of the first user separate from the video of the seconduser). The common smart mirror can also receive (and, optionally,analyze) biometric data from one or more wearable electronic accessoriesfrom the first user and/or the second user of the common smart mirrorduring the challenge workout. Similar to challenge workouts for users onseparate mirrors, the common smart mirror can determine scores for thefirst user and the second user (e.g., based on the video and/orbiometric data received by the common smart mirror) and identify thewinner of the challenge workout based on the scores. The winner of thechallenge workout can be displayed (as text, image(s) and/or audiooutput) via the GUI of the common smart mirror (and/or via the firstmobile compute device and/or via the second mobile compute device) andsaved in a least one memory for later retrieval and viewing.

In other embodiments, a user of a smart mirror in a given location canselect a challenge workout (e.g., by interacting with a GUI of the smartmirror or by interacting with a GUI of a mobile compute device of theuser), where the challenge workout includes a previously-recorded videoof the user performing a desired workout (and, optionally, including anoverlay of numeric and/or non-numeric scores calculated at the time ofthe previous recording). In response to selecting the challenge workout,the smart mirror displays (“replays”) the challenge workout, such thatthe user can “face off” against his/her own previous performance of theworkout. During the challenge workout, live video of the user, obtainedvia one or more video cameras of the smart mirror, is displayed via thesmart mirror display panel, along with the challenge workout (withoptional score overlay(s)) and, optionally, with an additional overlayof numeric and/or non-numeric scores based on the user's performanceduring the replay of the challenge workout. For example, in some suchembodiments, the user can view both his/her score(s) from thepreviously-recorded video and his/her score(s) calculated during thereplay, so that he/she can compare them and be motivated by them. Thescore(s) may change over time, throughout the duration of the challengeworkout. In some embodiments, rather than displaying the scores from thepreviously-recorded video and the scores calculated during the replayindividually, a numeric or non-numeric representation of the differencebetween the scores from the previously-recorded video and the scorescalculated during the replay may be generated and displayed (e.g., agraphic, such as a thermometer, that shows a user (for example, via acolor of the graphic, a length of the graphic, etc.) whether he/she isperforming better or worse than he/she did during thepreviously-recorded workout, at any given time). In other words, thegraphic can represent the user's “relative” performance, as comparedwith the previously-recorded workout. In some embodiments, an indicationof a current score, a previous score, or a total score (e.g., fromcurrent and previous scores) can be displayed in the display panel ofthe smart mirror (e.g., within the video of the user). In someembodiments, an indication of a current score, a previous score, and/ora total score can be stored and/or encoded in the memory of the mirror(e.g., as a file in memory, or as metadata of a recorded video file).

In still other embodiments, a first user of a first smart mirror in afirst location and a second user of a second smart mirror in a secondlocation (the second smart mirror being different from the first smartmirror and the first location being different from the second location)can be selected automatically for a challenge workout (referred toherein as a “face-off pairing”), by the app, based on a competitivecompatibility score generated using a competitive compatibilityalgorithm. The competitive compatibility algorithm can use some or allof the following data (i.e., competitive data) to determine face-offpairings: historical biometric data, current biometric data, historicalsensor data, current sensor data, historical workouts, historicalworkout performance, current workout and exercise, user preferences,user demographics, user location, and user friends/connections. Forexample, the app can select a second user (the second user being from aset of potential second users) for a face-off pairing with a first userby generating a competitive compatibility score for the first user andeach potential second user in the set of potential second users, andthen selecting the second user for a face-off pairing with the firstuser based on the highest competitive compatibility score generated foreach potential second user in the set of potential second users. Uponautomatic selection of a face-off pairing, the app can send challengerequests to the smart mirrors of the first user and the second user, fordisplay via a GUI thereof, such that the first user and the second usercan accept or deny the challenge request. If both the first user and thesecond user accept the challenge request, a challenge workout (e.g.,selected by the app, optionally also based on the competitivecompatibility algorithm) is displayed via both smart mirrorssimultaneously. For example, when the compatibility score is based onuser location, the app can select a second user for a face-off pairingwith the first user based on the first user and the second user beinglocated (or living) near each other. For another example, when thecompatibility score is based on user friends/connections, the app canselect a second user for a face-off pairing with the first user based onthe first user and the second user being previously or concurrentlydesignated as friends or connected together for certainfunctions/features (e.g., as described herein such as through a doubleopt-in process). Similarly, in some embodiments, a first user and asecond user of a common (single) smart mirror in a common (single)location can be selected for a face-off pairing, by the app, using thecompetitive compatibility algorithm. Upon selection of a face-offpairing, the app can send challenge requests to the common smart mirror,for display via the GUI thereof, such that the first user and the seconduser can accept or deny the challenge request. If both the first userand the second user or one of the first user or second user accepts thechallenge request, a challenge workout is displayed via the common smartmirror.

Note that although the face-off pairing process is described inconnection with an app, which can be located and operating for exampleat the smart mirror, mobile compute device and/or electronic accessoryof the first user, it should be understood that the face-off pairingprocess alternatively can be managed and controlled at a remote server(e.g., centralized server or a cloud-based server) with which the appcommunicates. In yet another alternative, the functionality of theface-off pairing process can be split between the app (located andoperating at the smart mirror, mobile compute device and/or electronicaccessory of the first user) and the remote server with which the appcommunicates.

In some embodiments, a first user of a first smart mirror can provide anindication of availability for a face-off pairing (e.g., by interactingwith a GUI of the smart mirror or by interacting with a GUI of a mobilecompute device of the user), such that a second user of a second smartmirror can be automatically identified for a face-off pairing based onthe indication of availability for a face-off pairing. For example, auser of smart mirror can provide an indication of availability for aface-off pairing when the user is engaged in a challenge workout, whenthe user is engaged in an exercise using the smart mirror, when the useris engaged in an exercise and not using the smart mirror, or when theuser is not engaged in an exercise and not using the smart mirror. Insome embodiments, the indication of availability for a face-off pairingcan be configured such that the app will only select a face-off pairingbetween a first user and a second user if the first user has priorknowledge of the second user (e.g., by previous interaction within theapp or by previous interaction outside the app). In some embodiments,the indication of availability for a face-off pairing can be configuredsuch that the app can select a face-off pairing between a first user anda second user in which the first user has no prior knowledge of thesecond user (e.g., the first user is willing to participate in aface-off pairing with a stranger). Thus, by providing an indication ofavailability for a face-off pairing, the first user can customize thetiming of their face-off pairings and customize the users to which theywill be selected for a face-off pairing.

In some embodiments, the app can identify face-off pairings based on athreshold score for the competitive compatibility score (generated usingthe competitive compatibility algorithm described above) such that theapp will not select face-off pairings for users with a competitivecompatibility score below the threshold score. The threshold score canbe pre-defined, determined automatically by the app based on thecompetitive data of a user, or defined by the user. For example, the appwill not identify a face-off pairing between a first user and a seconduser when their compatibility score is below a pre-defined thresholdscore. As another example, the app will not identify a face-off pairingbetween a first user and a second user when their compatibility score isbelow a threshold score as determined by the competitive data of thefirst user. In some embodiments, a first user can define a thresholdscore (e.g., via the GUI of the app) such that the app will not identifya face-off pairing between the first user and a second user when theircompatibility score is below the threshold score defined by the firstuser.

In some embodiments, the app can identify face-off pairings with a lowcompetitive compatibility score between a first user and a second user.In such face-off pairings, the first user and/or the second user canoptionally use a handicap to the workout challenge scores (i.e., thescores to identify the winner of the challenge workout) of the firstuser and/or second user. Thus, using a handicap to the workout challengescores can equalize competition between the first user and the seconduser in a challenge workout. For example, a first user and a second userwith a low competitive compatibility score can participate in achallenge workout in which the first user uses a handicap to theirworkout challenge score such that the handicapped workout challengescore is competitive with the workout challenge score of the seconduser. In some embodiments, a first user can provide an indication ofhandicapping for a face-off pairing (e.g., by interacting with a GUI ofthe smart mirror or by interacting with a GUI of a mobile compute deviceof the user), such that a second user of a second smart mirror can beautomatically identified for a face-off pairing based on the indicationof handicapping for a face-off pairing. The indication of handicappingcan indicate a user's preference for using a handicapped challengeworkout score. For example, a first user can provide an indication of ahandicapping so that the first user can compete in a workout challengewith a second user such that the first user and/or the second user usesa handicap to their workout challenge score. Alternatively, a first usercan provide an indication of handicapping so that the first user cancompete in a workout challenge with a second user such that the firstuser and/or second user does not use a handicap to their workoutchallenge score.

In some embodiments, the app uses AI to automatically identify face-offpairings that are predicted to promote increased future user engagement.The AI can be used to predict and/or target certain outcomes (e.g.,predefined outcomes) of the face-off pairings, such as: winning achallenge, losing a challenge, workout challenge scores or ranges ofscores (e.g., performance scores), connecting users (e.g., makingfriends), starting a subscription to new workout content, increasedpurchases of online content, participation in group and/or teamactivities, educating users, communicating between users, shareworkouts, etc. For example, AI can be used to target predefined outcomesby selecting a specified user having a higher predicted likelihood ofwinning certain challenges, and/or by selecting a specified user havinga higher predicted likelihood of losing certain challenges. In some suchembodiments, AI may select face-off pairings such that a user that hasbeen exercising less frequently is predicted to lose automaticallyidentified face-off pairings more frequently, and/or such that a userthat has been exercising more frequently is predicted to winautomatically identified face-off pairings more frequently. The AI canautomatically identify face-off pairings based on competitive data, suchas the competitive compatibility score described above.

In some embodiments, a networked plurality of smart mirrors can beconfigured (e.g., via a shared app, optionally also running on one ormore mobile compute devices of users of the smart mirrors) to host atournament competition including a plurality of face-off pairings. Eachface-off pairing can be broadcast via the networked plurality of smartmirrors to spectator users, participant users, and/or competitor userswithin the tournament (e.g., who have signed up for the tournament viathe app). The tournament competition can be hosted as a singlecompetitive event (i.e., in which a user or set of users is declared thewinner of the event) or can go on indefinitely (i.e., in which a user orset of users are consistently able to achieve or lose their rank in thetournament). For example, in some embodiments, the tournamentcompetition can be a ladder tournament, in which the app canautomatically update a user listing within a ladder (which may bedisplayed in each mirror of the networked plurality of mirrors) inreal-time or at a various times as the ladder tournament progresses. Forexample, users competing in a ladder tournament can move up or downtheir rank in the ladder based on the results of the face-off challenges(e.g., based on the comparison of the performance scores of users in theface-off challenges). The tournament competition can include eliminationof users based on the results of face-off challenges. For example, thetournament competition can be a knockout tournament, a round-robintournament, a single-elimination tournament, a double-eliminationtournament, a triple-elimination tournament, or a best-of-n tournament(in which a competitor must lose a majority of n games to beeliminated). In some embodiments, the app can determine and/or update aschedule and/or an indication of a schedule for competitors in atournament (e.g., a ladder schedule for a ladder tournament), as well asdetermine and/or update individual face-off pairings within thecompetition (e.g., initial rankings of competitors in a laddertournament). In some embodiments, the initial rankings of competitorswithin a tournament can be based, in part, on the competitivecompatibility scores of the competitors participating in the tournament.

In some embodiments, face-off pairings can be between at least two“teams” of smart mirror users, with each team including two or morecompetitors. During the face-off workouts, each team member within agiven face-off pairing can view, via his/her smart mirror, the videoand/or performance metrics (e.g., workout challenge scores) of the otherteam members, as well as the current metric totals for each team. Theteams can compete with each other in parallel or in series. Teams can beassigned a team score based on the individual workout challenge scoresof each team member. During the workout, each team member can contributesimultaneously or serially to the team score, and each member can viewtheir current team score. During the face-off workouts, teams and/orindividual team members can optionally use a handicap to their workoutchallenge scores, as described above.

In some embodiments, face-off pairings of individual users can beimplemented in a “tag team” format, such that a first user competes witha second user one-on-one, and when one of the users (e.g., the firstuser) tires out, a third user (e.g., viewing the face-off workout) can“tag” in and take the place of the first user, to continue the tag teamface-off workout (with the third user's being captured by the smartmirror of the third user and displayed via the smart mirror of the firstuser, the smart mirror of the second user and/or the smart mirror of thethird user) in a continuous manner. For example, when one of the users(e.g., the first user) tires out, that user can send an indication tostop the competition and to be replaced by another user on the same team(e.g., the third user) or the user on the same team (e.g., the thirduser) can send an indication to replace the prior user in thecompetition (e.g., the first user). Once the prior user (e.g., the firstuser) has been replaced with the user on the same team (e.g., the thirduser), a performance score for the team can be determined and/ordisplayed; such a performance score can be based, for example,collectively on the performance of the prior user during the competition(e.g., the first user) and the performance of the user on the same team(e.g., the third user). The performance score collectively for the prioruser (e.g., the first user) and the user on the same team (e.g., thethird user) can be calculated, for example, by weighting a performancemetric value of the prior user (e.g., the first user) based on the timefor which the prior user participated in the competition, weighting aperformance metric value of the user on the same team (e.g., the thirduser) based on the time for which the user on the same team participatedin the competition, and adding together the two weighted performancemetric values. Although the above discussion is specific to one teamparticipating in the competition, the above discussion can be applied toanother team participating in the competition such as a team comprisinganother prior user (e.g., the second user) and another user on that team(e.g., a fourth user).

Similarly, face-off pairings of individual users can be implemented in a“relay race” format, such that a first user competes with a second userone-on-one, and when each of the first user and the second user reachesa particular/predetermined stage (e.g., distance, time, etc.), a thirduser and a fourth user, take over for the first user and the seconduser, respectively, to continue the relay face-off workout in acontinuous manner.

In-Workout Spotlights:

In some embodiments, a plurality of users, each with his/her own smartmirror, participates, in parallel, in a common workout presented viatheir smart mirrors. During the workout, a “spotlight” display (e.g.,including text, graphics, images and/or animation) can be applied to orassociated with one or more selected users, and the spotlight displaycan be presented (e.g., as an overlay on a representation of theselected user(s)), via the smart mirrors of the participant users. Thespotlight display can be transient (e.g., configured to be displayed fora predetermined period of time). The user(s) selected to be“spotlighted” can be selected automatically (e.g., by the app, using analgorithm, rule(s) and/or schedule) or can be selected by one or more ofthe participant users. For example, a user who is celebrating a birthdayon the day of the workout can be automatically chosen for a spotlight,in response to determining (e.g., based on a calendar) that it ishis/her birthday.

In some embodiments, a spotlight display is generated, selected and/ordisplayed (e.g., by a smart mirror, an app running on the smart mirror,a remote server communicably coupled to the smart mirror, a mobilecompute device communicably coupled to the smart mirror, and/or an apprunning on the mobile compute device) using one or more AI algorithms.For example, an AI algorithm can identify, e.g., based on biometric dataof one or more users from the plurality of users collected within apredefined period of time, one or more users from the plurality of usersthat are determined to need, or to be most in need of, encouragement,inspiration, or motivation (e.g., based on a detected decline inintensity, power, etc.). In some such embodiments, where more than apredetermined threshold number of users from the plurality of users areidentified as needing encouragement, the AI algorithm and/or the app candown-select a subgroup of users from those identified as needingencouragement, such that spotlight displays are only displayed for thoseusers within the subgroup (e.g., to avoid visually crowding/overwhelmingthe display, diluting the message, etc.). Similarly and more generally,in other embodiments, where more than a predetermined threshold numberof users from the plurality of users are identified as candidates to be“spotlighted,” for example because they have birthdays or anniversaries,the AI algorithm and/or the app can down-select a subgroup of users fromthose candidates, such that spotlight displays are only displayed forthose users within the subgroup (e.g., to avoid visuallycrowding/overwhelming the display, diluting the message, etc.).

Friending

In some embodiments, a first user of a first smart mirror can “invite”at least a second user of a second smart mirror to become a friend via a“double-opt-in” process (i.e., both the first user and the second useragree to friend each other). A number of “friends” of the first user whohave previously completed a workout or attended a class, or who areactively participating in an ongoing instance of the workout, may bedisplayed and/or highlighted (optionally with prioritization) within theGUI of the given user's smart mirror during the workout or prior to theworkout. Alternatively or in addition, live video of one or more friendsof the first user may be displayed and/or highlighted (optionally withprioritization) during the workout, and/or icons, images, text, or otherrepresentations of the one or more friends of the first user may bedisplayed and/or highlighted (optionally with prioritization) during theworkout.

In some embodiments, a smart mirror of a first user displays (e.g.,during a workout) an activity feed that is viewable by the first userand, optionally, by friends of the first user (e.g., via theirrespective smart mirror). The activity feed can include data associatedwith the first user and with friends of the first user, including (butnot limited to) one or more of: name, username, location, online status,workout log, biometric data (e.g., heart rate data), images, videos,accomplishments, milestones, etc. A first user may interact with anactivity feed of a friended user, e.g., by posting text, emojis, videos,images, etc. in the activity feed.

In some embodiments, a smart mirror of a first user displays (e.g.,during a workout) a leaderboard of all friended users, a subset offriended users, or users from the entire networked smart mirrorcommunity. Positioning of users within the leaderboard can be based onany or all of the following metrics: workouts completed, biometric data(e.g., heart rate data), points earned during competitive (e.g.,“challenge”) workouts, and values calculated based on the foregoing data(e.g., most improved user(s)). The leaderboard can include a “podium”section (e.g., at the top of the leaderboard) that includes a predefinednumber (e.g., two, three, four, or five) of the highest-ranked users.

Trending Workouts

In some embodiments, workouts that are “trending” in a predefinedcommunity or subset of the community (e.g., a subset of the communitythat includes users similar to a first user) can be displayed via asmart mirror to the first user. As used herein, “trending” can refer tothe condition of having a high overall rating, a high recent rating(e.g., within a predefined preceding period of time), a high overallusage, a high recent usage (e.g., within a predefined preceding periodof time), etc. Trends can be defined and/or identified using one or moreAI algorithms. For example, AI can be used to determine a desirable timewindow over which to identify trends (e.g., day, week, month, season)and/or a desirable geographic region within which to identify trends(e.g., country, state, county, city) and/or a desirable subset of usersamong which to identify trends (e.g., demographics, fitness level,workout frequency, user preferences, user settings, friends, etc.), suchthat a predicted level of user engagement resulting from the trendingdisplays is higher/highest. Trends can be associated with a particularexercise type (e.g., yoga, running, boxing).

Milestones

In some embodiments, a plurality of users, each with his/her own smartmirror, participates, in parallel, in a common workout presented viatheir smart mirrors. During, before and/or after the workout, one ormore “milestones” (e.g., notable events) can be displayed or otherwisepresented via one or more smart mirrors (e.g., as text, audio, video,graphics, images, GIFs, etc.). A milestone can be identified (e.g., by aserver, by one or more of the smart mirrors, an app running on one ormore of the smart mirrors and/or an app running on one or more mobilecompute devices) based, for example, on one or more of: classperformance (e.g., based on data gathered during a workout, such asvideo data and biometric data), exercise performance (e.g., based ondata gathered while performing the exercise, such as video data andbiometric data), class attendance, performance across workouts (e.g.,based on data gathered during a workout, such as video data andbiometric data), calendar events (e.g., anniversary of signing up viathe smart mirror, birthday, friend anniversaries), and smart mirrorcommunity or social interactions. Milestones can be displayed accordingto a predefined schedule, and thus may expected by the user(s).Alternatively, milestones can be surprise and/or unexpectedachievements, such that the user(s) are not expecting to see them. AIcan be used to determine one of the following, with regard tomilestones: time(s)/date(s) for presenting surprise achievementmilestones having the highest predicted likelihood ofpromoting/triggering future user engagement, types of surpriseachievement milestones predicted to “delight” or be welcomed by aparticular user, timing of the presentation of surprise achievementmilestones during a workout, such that the user has a favorable response(rather than a negative response) to the milestone, a maximum frequencyat which milestones may be displayed, such that a predicted likelihoodof promoting/triggering future user engagement is highest, etc.

Virtual “Locker Room” Sessions

In some embodiments, a smart mirror app is configured to simulate aninteractive “locker room” environment before and/or after a workout.FIG. 4 is a diagram showing an example locker room implementation, inaccordance with some embodiments. As shown in FIG. 4 , during a firsttime interval (Time Interval 1—first virtual locker room), users A, E,and F are active (e.g., they are in front of their respective smartmirrors, optionally with their video cameras on, or have their app openon their mobile compute device(s)). At least a subset of the users A, E,and F may plan to participate in a common scheduled workout (which canbe either a “live” workout or an “encore” workout). The first timeinterval precedes the time at which the workout is scheduled to begin.During the first time interval, the users A, E, and F can see andcommunicate with each other via voice, video, and/or chat (e.g.,including text, image, emojis, GIFs (e.g., virtual towel snap GIF),etc.). Also during the first time interval, one or more user-selectedbackgrounds (e.g., images uploaded by each user or by a user thatorganized the workout) and/or images selected by the smart mirror app(e.g., according to one or more predefined rules and/or algorithms) canbe displayed within the smart mirror of each of users A, E, and F.Images selected by the smart mirror app can include, for example, imagesof products for promotion and/or images depicting the rendering ofservices for promotion. The selection of images of products forpromotion and/or images depicting the rendering of services forpromotion can be based on one or more rules and/or algorithms based, forexample, on user demographics, user preferences, user location data,user purchase history, etc. From the point of view of, for example, userA, other active users E and F can be “seen” via live video stream and/orvia other representations, such as avatars, images, text, etc. In someembodiments, the visual/displayed appearance (e.g., including thebackground) of the first virtual locker room automatically changes asdifferent users talk (e.g., concurrent with the current speaker beingfeatured/enlarged within the viewable area). In some embodiments, ananimation is displayed, to participants of the first virtual locker roomand during the first time interval, of people getting ready for aworkout (e.g., putting on shoes, warming up, etc.).

During a second time interval (Time Interval 2—scheduled workout), aninstructor 401 and users A, B, C, and F are active (e.g., they are infront of their respective smart mirrors, optionally with their videocameras on). During a third time interval (Time Interval 3—secondvirtual locker room), users D, B, and F are active (e.g., they are infront of their respective smart mirrors, optionally with their videocameras on, or have their app open on their mobile compute device(s)).Users B and F participated in the preceding workout (during the secondtime interval), whereas user D did not. During the third time interval(similar to during the first time interval), the users B, D, and F cansee and communicate with each other via voice, video, and/or chat (e.g.,including text, image, emojis, GIFs (e.g., virtual towel snap GIF),etc.). Also during the third time interval, a user-selected background(e.g., an image uploaded by each user) can be displayed within the smartmirror of each of users A, E, and F. From the point of view of, forexample, user B, other active users D and F can be “seen” via live videostream and/or via other representations, such as avatars, images, text,etc. In some embodiments, the visual/displayed appearance (e.g.,including the background) of the first virtual locker room automaticallychanges as different users talk (e.g., concurrent with the currentspeaker being featured/enlarged within the viewable area). In someembodiments, an animation is displayed, to participants of the secondvirtual locker room and during the third time interval, of people doingpost-workout activities (e.g., taking off shoes, cooling down, etc.).

In some embodiments, during the first virtual locker room and/or thesecond virtual locker room, the smart mirror displays of allparticipants are synchronized such that they display the same eventsoccurring at the same time (e.g., users entering and exiting the virtuallocker room), For example, if three users are in the virtual lockerroom, and a fourth user enters the locker room, the three users cansimultaneously view that fourth user entering. As the fourth userenters, he/she sees the three friends already there in the virtuallocker room.

Biometric Connector Systems

In some embodiments, a biometric “connector” apparatus is sized andshaped to connect to, attach to, or be embedded within, at least one ofexercise equipment, apparel, footwear (e.g., one shoe or both shoes), orthe body of a user, and contains a microcontroller communicably coupledto a plurality of sensors (optionally including at least one “onboard”sensor). The plurality of sensors includes sensors for detecting datathat directly measures, or is used in the calculation of, one or more ofthe following non-exhaustive list of biometric data: position (e.g., viaa global positioning system (GPS) sensor, altimeter, etc.), orientationor rotation (e.g., via a gyroscope, magnetometer, etc.), acceleration(e.g., via 3-axis accelerometer(s)), speed/velocity (e.g., limb speed,running speed, etc.), cadence, pace, gait, vibration, muscle activation(i.e., which muscle(s) are being activated, and to what degree) (e.g.,using a stretch sensor, vibration sensor, etc.), temperature, humidity,oxygen levels (e.g., blood oxygen level, blood oxygen saturation, etc.),salinity, breathing rate, heart rate (e.g. via a bioimpedance sensor,optical sensor, photoplethysmography (PPS) sensor, etc.), muscle twitchresponse, heart rate recovery, perspiration rate, intensity, linearforce, linear movement, rotational force, rotational movement, power(e.g., running power), repetition counts such as steps (e.g., via apedometer), range of motion, movement patterns/trajectories, gestures,facial features (e.g., via facial recognition sensors), flexibility,endurance, strength, body fat, and hydration level.

In some embodiments, a biometric connector system includes one or morebiometric connector apparatuses, each configured to communicate (e.g.,via Bluetooth® or other wireless network communications protocol) withone or more smart mirrors. During use (e.g., during a workout), thebiometric connector apparatus(es) detect biometric data for a userperforming the workout, optionally store the biometric data locally(within the biometric connector apparatus(es)), and generate andtransmit signals representing the biometric data to the smart mirror(and/or to an app running on the smart mirror, and/or to a mobilecompute device of the user). Once received, one or more of the followingactions can be performed: the biometric data can be stored in memory, arepresentation of the biometric data (e.g., in text, graphic, and/oraudio form) can be presented to the user via the smart mirror and/or viathe mobile compute device), an alert can be generated based on thebiometric data and presented to the user (e.g., in text, graphic, and/oraudio form) via the smart mirror and/or via the mobile compute device),one or more recommendations (e.g., to correct form, to reduce intensity,to begin cool down, to increase intensity, to hydrate, to change to adifferent workout, etc.) can be generated based on the biometric data(e.g., according to one or more predetermined rules and/or based on oneor more algorithms) and presented to the user (e.g., in text, graphic,and/or audio form) via the smart mirror and/or via the mobile computedevice), etc.

In some embodiments, a biometric connector system includes one or morebiometric connector apparatuses, each configured to communicate (e.g.,via Bluetooth® or other wireless network communications protocol) withone or more smart mirrors (and/or with any other wall-mounted orfreestanding appliance (including, but not limited to, other types ofexercise equipment) having a display monitor/screen). During use (e.g.,during a workout), the biometric connector apparatus(es) detectbiometric data for a user performing the workout, optionally store thebiometric data locally (within the biometric connector apparatus(es)),transform (e.g., via a microcontroller or processor thereof) thebiometric data based on one or more algorithms to produce transformedbiometric data (optionally having a non-numeric format, such as agraphical representation(s), sound(s) of varying intensity, color(s) ofvarying intensity, vibration(s) of varying intensity, or other sensoryoutput(s)), and generate and transmit signals representing thetransformed biometric data to the smart mirror (and/or an app running onthe smart mirror, and/or a mobile compute device of the user) forpresentation. The one or more algorithms can include one or more of:machine learning algorithms, statistical algorithms, unit conversionalgorithms, biometric algorithms, encryption algorithms, and datacompression algorithms. The transformed biometric data can include oneor more of: compressed data, encrypted data, converted data, andmodified data. Once received, one or more of the following actions canbe performed: the transformed biometric data can be stored in memory, arepresentation of the transformed biometric data (e.g., in text,graphic, and/or audio form) can be presented to the user via the smartmirror and/or via the mobile compute device), an alert can be generatedbased on the transformed biometric data and presented to the user (e.g.,in text, graphic, and/or audio form) via the smart mirror and/or via themobile compute device, one or more recommendations (e.g., to correctform, to reduce intensity, to begin cool down, to increase intensity, tohydrate, to change to a different workout, etc.) can be generated basedon the transformed biometric data (e.g., according to one or morepredetermined rules and/or based on one or more algorithms) andpresented to the user (e.g., in text, graphic, and/or audio form) viathe smart mirror and/or via the mobile compute device), etc.

In some embodiments, a biometric connector system includes multiplebiometric connector apparatuses, each configured to communicate (e.g.,via Bluetooth® or other wireless network communications protocol) withone or more smart mirrors (and/or with any other wall-mounted orfreestanding appliance (including, but not limited to, other types ofexercise equipment) having a display monitor/screen). At least onebiometric connector apparatus from the multiple biometric connectorapparatuses is attached to, embedded in, or otherwise associated withanother type of exercise equipment, such as a treadmill, ellipticaltrainer, stationary bicycle, stair-stepper, rowing machine,cross-country ski machine, etc. The one or more smart mirrors (and/or anapp running on the smart mirror(s), and/or mobile compute device(s) ofthe user(s)), upon receipt of biometric data from the other exerciseequipment, may detect a type of exercise equipment associated with thebiometric data, and select an algorithm and/or rule set for interpretingthe biometric data based on the detected type of exercise equipment.

In addition to, or alternatively to, the sensors and detectiontechniques described herein, vibration, muscle activation, and otherbiometric data can be generated by one or more sensors and/or techniquesdescribed in U.S. Pat. No. 8,912,909, issued Dec. 16, 2014 and titled“Noninvasive Multi-Parameter Patient Monitor”; U.S. Patent ApplicationPublication Number 2018/0271409, published Sep. 27, 2018 and titled“Body Part Motion Analysis with Wearable Sensors”; and U.S. PatentApplication Publication Number 2019/0022388, published Jan. 24, 2019 andtitled “Device and System to Measure and Assess Superficial MuscleContractile Characteristics,” the entire contents of each of which areherein incorporated by reference in their entireties for all purposes.

In some embodiments, biometric data is gathered, over time, from each ofa plurality of networked smart mirrors (and/or from any otherwall-mounted or freestanding appliance (including, but not limited to,other types of exercise equipment) having a display monitor/screen) andfor each of a plurality of smart mirror users, and stored in acentralized repository (e.g., a cloud server). One or more machinelearning models can be trained using the stored biometric data, toproduce one or more trained machine learning models. The one or moretrained machine learning models can detect, optionally adaptively overtime (by retraining the one or more trained machine learning modelsbased on additional biometric data gathered since the previous machinelearning training), trends among subgroups of smart mirror users, suchas: workout popularity, low performance statistics for individualworkouts, high performance statistics for individual workouts, highinteraction with other users during certain time periods, highinteraction with other users during certain workouts, high interactionwith other users on certain days, high interaction with other users forcertain instructors, etc.

In some embodiments, biometric data is gathered, over time, from each ofa plurality of networked smart mirrors (and/or from any otherwall-mounted or freestanding appliance (including, but not limited to,other types of exercise equipment) having a display monitor/screen) andfor each of a plurality of smart mirror users, and stored in acentralized repository (e.g., a cloud server). One or more machinelearning models can be trained using a subset of the stored biometricdata, the subset of the stored biometric data being selected based onone or more properties of a given user (e.g., biometric data, age,gender, height, weight, workout preferences, past workout performance,fitness level, etc.) to produce one or more trained machine learningmodels. The one or more trained machine learning models can thengenerate, optionally adaptively over time (by retraining the one or moretrained machine learning models based on additional biometric datagathered since the previous machine learning training), recommendationsfor the user, including one or more of (but not limited to): recommendedmodifications to form (e.g., body positioning), workout recommendations,instructor recommendations, “friend” (i.e., other smart mirror user)recommendations, etc. The recommendations can also be based, in part, onone or more predefined user-customizable goals. For example, the trainedmachine learning model(s) can generate recommendations that arepredicted to result in the user moving closer to his/her goal(s).Examples of user-customizable goals can include metrics such as (but notlimited to): fitness level, mastery score (discussed further below),sport-specific fitness level (e.g., specific to yoga, running,calisthenics, cycling, biometric data (e.g., during the performance ofone or more specified workouts), sport-specific form, sport-specificperformance, workout-specific form, workout-specific performance,exercise-specific form, or exercise-specific performance. In someimplementations, a first user can customize his/her goals by inputting(via a GUI of the smart mirror or mobile compute device) a name oridentifier of one or more other smart mirror users, along with themetric(s) of that other smart mirror user that the first user would liketo attain or progress toward.

Biometric Connector Software

In some embodiments, a biometric connector system includes a connectorsoftware application having instructions to cause a processor tocalculate a mastery score (or “fluidity score”) according to analgorithm. In one example, the mastery score is calculated based on anumber of repetitions completed, one or more movement patterns, bodypositioning data (e.g., including coordinates within three-dimensionalspace and representations of associated body parts), muscleusage/activation data, cadence, and heart rate recovery data for a givenuser. In some such implementations, the algorithm combines calculatedvalues (e.g., from one or more sensors) with raw sensor data todetermine the mastery score. Once calculated, the mastery score can bepresented to the user (e.g., in text, graphic, and/or audio form) viathe smart mirror and/or via the mobile compute device of the user.

In some embodiments, a biometric connector system includes a connectorsoftware application having instructions to cause a processor to capturevideo of a user completing exercises, during a first workout period, andstores that video as a first archive video (optionally associated, inmemory, with one or more of: a timestamp, date stamp, and biometricdata). During a second workout period subsequent to the first workoutperiod, the connector software application can be configured to causedisplay, via the smart mirror, of an overlay of the first archive video,optionally in combination with the biometric data of the first archivevideo, such that the user can see his/her reflected image concurrentlywith the first archive video of himself/herself (e.g., forself-comparison, competition with one's own prior performance, etc.).

In some embodiments, a biometric connector system includes a connectorsoftware application having instructions to cause a processor to combinevideo camera data/imagery captured by a smart mirror of a user withbiometric data generated based on one or more wearable electronicaccessories of the user (optionally synchronized in time or matchedbased on time of capture/generation) to define composite data, and makedeterminations based on the composite data or based on the video cameradata/imagery and the biometric data sequentially. For example, amovement (e.g., a vibration, shaking, contraction, etc.) of the user canbe detected based on the video camera data/imagery, and biometric data(e.g., generated by a vibration sensor, stretch sensor and/or othersensor) can be used to confirm the movement and/or specify whichmuscle(s) are most exhibiting the movement, relative to other muscles ofthe user. Alternatively, the movement of the user can be detected basedon the biometric data, and the video camera data/imagery can be used toconfirm the movement and/or specify which muscle(s) are most exhibitingthe movement, relative to other muscles of the user. In some suchembodiments, the video camera data/imagery, the biometric data, and/orthe composite data can be compared to one or more expected valuesassociated with a workout being performed by the user, via the smartmirror, concurrently with the capture of the video camera data/imageryand the generation of the biometric data. Based on the comparison, theconnector software application may determine whether a given exercise is(or was) being properly performed by the user, and/or to assess a formor other performance of the user. Optionally, the determination as towhether a given exercise is (or was) being properly performed by theuser, and/or to assess a form or other performance of the user can befurther based on audio data generated by one or more microphones of thesmart mirror.

In some embodiments, optionally in combination with any of the precedingembodiments, biometric data can be used by the connector softwareapplication to calculate or infer a power (e.g., a running power) of auser during a workout. As used herein, “power” can refer to a user'sability to move weight with speed (also referred to as “explosiveness”).Power can be calculated, for example, using one or more techniquesdescribed in U.S. Pat. No. 10,744,371, issued Aug. 18, 2020 and titled“Methods and Apparatus for Power Expenditure and Technique DeterminationDuring Bipedal Motion,” and in U.S. Patent Application PublicationNumber 2017/0189752, published Jul. 6, 2017 and titled “Methods andApparatus for Power Expenditure and Technique Determination DuringBipedal Motion,” the entire contents of each of which are hereinincorporated by reference in their entireties for all purposes. Theconnector software application can compare calculated power for a giventime period and for a given user, with at least one other biometric dataparameter, to confirm accuracy and/or to generate a more completestatistical profile of the user's performance during a given workout,sport, exercise, etc., which can be tracked over time. FIG. 5 is adiagram showing an example of interrelatedness of certain biometric dataparameters (namely, heart rate, rate of perceived exertion (RPE), pace,and power) for a user running uphill, downhill, and on flat terrain. Asan example, referring to FIG. 5 , in some embodiments, the connectorsoftware application can compare calculated power for a first timeperiod, during which a user is running uphill and then transitions torunning downhill, with a heart rate, pace, and/or RPE of the user forthe same time period, to confirm that the measurements of the associatedsensors are accurate. As shown in FIG. 5 , if the sensors are performingcorrectly, the heart rate and RPE (for the first time period) shouldincrease, plateau, and then decrease; the pace should increase when theuser is running downhill, relative to when the user was running uphill;and the power should decrease when the user is running downhill,relative to when the user was running uphill (e.g., at a faster ratethan the decrease(s) of RPE and/or heart rate during the downhillsegment of the run).

All combinations of the foregoing concepts and additional conceptsdiscussed herewithin (provided such concepts are not mutuallyinconsistent) are contemplated as being part of the subject matterdisclosed herein. The terminology explicitly employed herein that alsomay appear in any disclosure incorporated by reference should beaccorded a meaning most consistent with the particular conceptsdisclosed herein.

The drawings are primarily for illustrative purposes, and are notintended to limit the scope of the subject matter described herein. Thedrawings are not necessarily to scale; in some instances, variousaspects of the subject matter disclosed herein may be shown exaggeratedor enlarged in the drawings to facilitate an understanding of differentfeatures. In the drawings, like reference characters generally refer tolike features (e.g., functionally similar and/or structurally similarelements).

The entirety of this application (including the Cover Page, Title,Headings, Background, Summary, Brief Description of the Drawings,Detailed Description, Embodiments, Abstract, Figures, Appendices, andotherwise) shows, by way of illustration, various embodiments in whichthe embodiments may be practiced. The advantages and features of theapplication are of a representative sample of embodiments only, and arenot exhaustive and/or exclusive. Rather, they are presented to assist inunderstanding and teach the embodiments, and are not representative ofall embodiments. As such, certain aspects of the disclosure have notbeen discussed herein. That alternate embodiments may not have beenpresented for a specific portion of the innovations or that furtherundescribed alternate embodiments may be available for a portion is notto be considered to exclude such alternate embodiments from the scope ofthe disclosure. It will be appreciated that many of those undescribedembodiments incorporate the same principles of the innovations andothers are equivalent. Thus, it is to be understood that otherembodiments may be utilized and functional, logical, operational,organizational, structural and/or topological modifications may be madewithout departing from the scope and/or spirit of the disclosure. Assuch, all examples and/or embodiments are deemed to be non-limitingthroughout this disclosure.

Also, no inference should be drawn regarding those embodiments discussedherein relative to those not discussed herein other than it is as suchfor purposes of reducing space and repetition. For instance, it is to beunderstood that the logical and/or topological structure of anycombination of any program components (a component collection), othercomponents and/or any present feature sets as described in the figuresand/or throughout are not limited to a fixed operating order and/orarrangement, but rather, any disclosed order is exemplary and allequivalents, regardless of order, are contemplated by the disclosure.

Various concepts may be embodied as one or more methods, of which atleast one example has been provided. The acts performed as part of themethod may be ordered in any suitable way. Accordingly, embodiments maybe constructed in which acts are performed in an order different thanillustrated, which may include performing some acts simultaneously, eventhough shown as sequential acts in illustrative embodiments. Putdifferently, it is to be understood that such features may notnecessarily be limited to a particular order of execution, but rather,any number of threads, processes, services, servers, and/or the likethat may execute serially, asynchronously, concurrently, in parallel,simultaneously, synchronously, and/or the like in a manner consistentwith the disclosure. As such, some of these features may be mutuallycontradictory, in that they cannot be simultaneously present in a singleembodiment. Similarly, some features are applicable to one aspect of theinnovations, and inapplicable to others.

The term “automatically” is used herein to modify actions that occurwithout direct input or prompting by an external source such as a user.Automatically occurring actions can occur periodically, sporadically, inresponse to a detected event (e.g., a user logging in), or according toa predetermined schedule.

The term “determining” encompasses a wide variety of actions and,therefore, “determining” can include calculating, computing, processing,deriving, investigating, looking up (e.g., looking up in a table, adatabase or another data structure), ascertaining and the like. Also,“determining” can include receiving (e.g., receiving information),accessing (e.g., accessing data in a memory) and the like. Also,“determining” can include resolving, selecting, choosing, establishingand the like.

The phrase “based on” does not mean “based only on,” unless expresslyspecified otherwise. In other words, the phrase “based on” describesboth “based only on” and “based at least on.”

Some embodiments and/or methods described herein can be performed bysoftware (executed on hardware), hardware, or a combination thereof.Hardware modules may include, for example, a processor, a fieldprogrammable gate array (FPGA), and/or an application specificintegrated circuit (ASIC). Software modules (executed on hardware) caninclude instructions stored in a memory that is operably coupled to aprocessor, and can be expressed in a variety of software languages(e.g., computer code), including C, C++, Java™, Ruby, Visual Basic™,and/or other object-oriented, procedural, or other programming languageand development tools. Examples of computer code include, but are notlimited to, micro-code or micro-instructions, machine instructions, suchas produced by a compiler, code used to produce a web service, and filescontaining higher-level instructions that are executed by a computerusing an interpreter. For example, embodiments may be implemented usingimperative programming languages (e.g., C, Fortran, etc.), functionalprogramming languages (Haskell, Erlang, etc.), logical programminglanguages (e.g., Prolog), object-oriented programming languages (e.g.,Java, C++, etc.) or other suitable programming languages and/ordevelopment tools. Additional examples of computer code include, but arenot limited to, control signals, encrypted code, and compressed code.

The term “processor” should be interpreted broadly to encompass ageneral purpose processor, a central processing unit (CPU), amicroprocessor, a digital signal processor (DSP), a controller, amicrocontroller, a state machine and so forth. Under some circumstances,a “processor” may refer to an application specific integrated circuit(ASIC), a programmable logic device (PLD), a field programmable gatearray (FPGA), etc. The term “processor” may refer to a combination ofprocessing devices, e.g., a combination of a DSP and a microprocessor, aplurality of microprocessors, one or more microprocessors in conjunctionwith a DSP core or any other such configuration.

The term “memory” should be interpreted broadly to encompass anyelectronic component capable of storing electronic information. The termmemory may refer to various types of processor-readable media such asrandom access memory (RAM), read-only memory (ROM), non-volatile randomaccess memory (NVRAM), programmable read-only memory (PROM), erasableprogrammable read only memory (EPROM), electrically erasable PROM(EEPROM), flash memory, magnetic or optical data storage, registers,etc. Memory is said to be in electronic communication with a processorif the processor can read information from and/or write information tothe memory. Memory that is integral to a processor is in electroniccommunication with the processor.

The terms “instructions” and “code” should be interpreted broadly toinclude any type of computer-readable statement(s). For example, theterms “instructions” and “code” may refer to one or more programs,routines, sub-routines, functions, procedures, etc. “Instructions” and“code” may comprise a single computer-readable statement or manycomputer-readable statements.

Some embodiments described herein relate to a computer storage productwith a non-transitory computer-readable medium (also can be referred toas a non-transitory processor-readable medium) having instructions orcomputer code thereon for performing various computer-implementedoperations. The computer-readable medium (or processor-readable medium)is non-transitory in the sense that it does not include transitorypropagating signals per se (e.g., a propagating electromagnetic wavecarrying information on a transmission medium such as space or a cable).The media and computer code (also can be referred to as code) may bethose designed and constructed for the specific purpose or purposes.Examples of non-transitory computer-readable media include, but are notlimited to, magnetic storage media such as hard disks, floppy disks, andmagnetic tape; optical storage media such as Compact Disc/Digital VideoDiscs (CD/DVDs), Compact Disc-Read Only Memories (CD-ROMs), andholographic devices; magneto-optical storage media such as opticaldisks; carrier wave signal processing modules; and hardware devices thatare specially configured to store and execute program code, such asApplication-Specific Integrated Circuits (ASICs), Programmable LogicDevices (PLDs), Read-Only Memory (ROM) and Random-Access Memory (RAM)devices. Other embodiments described herein relate to a computer programproduct, which can include, for example, the instructions and/orcomputer code discussed herein.

Some embodiments and/or methods described herein can be performed bysoftware (executed on hardware), hardware, or a combination thereof.Hardware modules may include, for example, a general-purpose processor,a field programmable gate array (FPGA), and/or an application specificintegrated circuit (ASIC). Software modules (executed on hardware) canbe expressed in a variety of software languages (e.g., computer code),including C, C++, Java™, Ruby, Visual Basic™, and/or otherobject-oriented, procedural, or other programming language anddevelopment tools. Examples of computer code include, but are notlimited to, micro-code or micro-instructions, machine instructions, suchas produced by a compiler, code used to produce a web service, and filescontaining higher-level instructions that are executed by a computerusing an interpreter. For example, embodiments may be implemented usingimperative programming languages (e.g., C, Fortran, etc.), functionalprogramming languages (Haskell, Erlang, etc.), logical programminglanguages (e.g., Prolog), object-oriented programming languages (e.g.,Java, C++, etc.) or other suitable programming languages and/ordevelopment tools. Additional examples of computer code include, but arenot limited to, control signals, encrypted code, and compressed code.

Various concepts may be embodied as one or more methods, of which atleast one example has been provided. The acts performed as part of themethod may be ordered in any suitable way. Accordingly, embodiments maybe constructed in which acts are performed in an order different thanillustrated, which may include performing some acts simultaneously, eventhough shown as sequential acts in illustrative embodiments. Putdifferently, it is to be understood that such features may notnecessarily be limited to a particular order of execution, but rather,any number of threads, processes, services, servers, and/or the likethat may execute serially, asynchronously, concurrently, in parallel,simultaneously, synchronously, and/or the like in a manner consistentwith the disclosure. As such, some of these features may be mutuallycontradictory, in that they cannot be simultaneously present in a singleembodiment. Similarly, some features are applicable to one aspect of theinnovations, and inapplicable to others.

In addition, the disclosure may include other innovations not presentlydescribed. Applicant reserves all rights in such innovations, includingthe right to embodiment such innovations, file additional applications,continuations, continuations-in-part, divisionals, and/or the likethereof. As such, it should be understood that advantages, embodiments,examples, functional, features, logical, operational, organizational,structural, topological, and/or other aspects of the disclosure are notto be considered limitations on the disclosure as defined by theembodiments or limitations on equivalents to the embodiments. Dependingon the particular desires and/or characteristics of an individual and/orenterprise user, database configuration and/or relational model, datatype, data transmission and/or network framework, syntax structure,and/or the like, various embodiments of the technology disclosed hereinmay be implemented in a manner that enables a great deal of flexibilityand customization as described herein.

All definitions, as defined and used herein, should be understood tocontrol over dictionary definitions, definitions in documentsincorporated by reference, and/or ordinary meanings of the definedterms.

As used herein, in particular embodiments, the terms “about” or“approximately” when preceding a numerical value indicates the valueplus or minus a range of 10%. Where a range of values is provided, it isunderstood that each intervening value, to the tenth of the unit of thelower limit unless the context clearly dictates otherwise, between theupper and lower limit of that range and any other stated or interveningvalue in that stated range is encompassed within the disclosure. Thatthe upper and lower limits of these smaller ranges can independently beincluded in the smaller ranges is also encompassed within thedisclosure, subject to any specifically excluded limit in the statedrange. Where the stated range includes one or both of the limits, rangesexcluding either or both of those included limits are also included inthe disclosure.

The indefinite articles “a” and “an,” as used herein in thespecification and in the embodiments, unless clearly indicated to thecontrary, should be understood to mean “at least one.”

The phrase “and/or,” as used herein in the specification and in theembodiments, should be understood to mean “either or both” of theelements so conjoined, i.e., elements that are conjunctively present insome cases and disjunctively present in other cases. Multiple elementslisted with “and/or” should be construed in the same fashion, i.e., “oneor more” of the elements so conjoined. Other elements may optionally bepresent other than the elements specifically identified by the “and/or”clause, whether related or unrelated to those elements specificallyidentified. Thus, as a non-limiting example, a reference to “A and/orB”, when used in conjunction with open-ended language such as“comprising” can refer, in one embodiment, to A only (optionallyincluding elements other than B); in another embodiment, to B only(optionally including elements other than A); in yet another embodiment,to both A and B (optionally including other elements); etc.

As used herein in the specification and in the embodiments, “or” shouldbe understood to have the same meaning as “and/or” as defined above. Forexample, when separating items in a list, “or” or “and/or” shall beinterpreted as being inclusive, i.e., the inclusion of at least one, butalso including more than one, of a number or list of elements, and,optionally, additional unlisted items. Only terms clearly indicated tothe contrary, such as “only one of” or “exactly one of,” or, when usedin the embodiments, “consisting of,” will refer to the inclusion ofexactly one element of a number or list of elements. In general, theterm “or” as used herein shall only be interpreted as indicatingexclusive alternatives (i.e. “one or the other but not both”) whenpreceded by terms of exclusivity, such as “either,” “one of,” “only oneof,” or “exactly one of.” “Consisting essentially of,” when used in theembodiments, shall have its ordinary meaning as used in the field ofpatent law.

As used herein in the specification and in the embodiments, the phrase“at least one,” in reference to a list of one or more elements, shouldbe understood to mean at least one element selected from any one or moreof the elements in the list of elements, but not necessarily includingat least one of each and every element specifically listed within thelist of elements and not excluding any combinations of elements in thelist of elements. This definition also allows that elements mayoptionally be present other than the elements specifically identifiedwithin the list of elements to which the phrase “at least one” refers,whether related or unrelated to those elements specifically identified.Thus, as a non-limiting example, “at least one of A and B” (or,equivalently, “at least one of A or B,” or, equivalently “at least oneof A and/or B”) can refer, in one embodiment, to at least one,optionally including more than one, A, with no B present (and optionallyincluding elements other than B); in another embodiment, to at leastone, optionally including more than one, B, with no A present (andoptionally including elements other than A); in yet another embodiment,to at least one, optionally including more than one, A, and at leastone, optionally including more than one, B (and optionally includingother elements); etc.

In the embodiments, as well as in the specification above, alltransitional phrases such as “comprising,” “including,” “carrying,”“having,” “containing,” “involving,” “holding,” “composed of,” and thelike are to be understood to be open-ended, i.e., to mean including butnot limited to. Only the transitional phrases “consisting of” and“consisting essentially of” shall be closed or semi-closed transitionalphrases, respectively, as set forth in the United States Patent OfficeManual of Patent Examining Procedures, Section 2111.03.

The invention claimed is:
 1. A method, comprising: receiving, at acompute device of a user, a selection of a workout that is associatedwith a previously-recorded video file (1) representing apreviously-recorded video of the user performing the workout during afirst time period, and (2) including a performance score of the userduring the first time period, the compute device of the user including afirst processor; wirelessly transmitting a signal representing theselection from the compute device to a smart mirror of the user, thesmart mirror of the user including a second processor different from thefirst processor; receiving, at the smart mirror of the user, from thecompute device of the user and via a wireless telecommunicationsnetwork, the signal representing the selection; displaying, at the smartmirror of the user and during a second time period after the first timeperiod, the previously-recorded video, in response to the selection; andreflecting, at the smart mirror of the user during the second timeperiod, an image of the user performing the workout.
 2. The method ofclaim 1, further comprising: displaying, at the smart mirror of the userduring the second time period, a representation of a performance scoreof the user during the second time period and a representation of theperformance score of the user during the first time period.
 3. Themethod of claim 1, further comprising: displaying, at the smart mirrorof the user during the second time period, a numeric representation ofthe performance score of the user during the first time period and anumeric representation of a performance score of the user during thesecond time period.
 4. The method of claim 1, further comprising:displaying, at the smart mirror of the user during the second timeperiod, a numeric representation of a difference between the performancescore of the user during the first time period and a performance scoreof the user during the second time period.
 5. The method of claim 1,further comprising: displaying, at the smart mirror of the user duringthe second time period, a non-numeric representation of a differencebetween the performance score of the user during the first time periodand a performance score of the user during the second time period. 6.The method of claim 1, wherein the compute device of the user is atleast one of a smart phone of the user or the smart mirror of the user.7. The method of claim 1, further comprising: displaying, at the smartmirror of the user during the second time period, live video of the userperforming the workout.
 8. The method of claim 1, further comprising:displaying, at the smart mirror of the user during the second timeperiod, a graphic representation of a performance of the user during thesecond time period relative to the performance score of the user duringthe first time period.
 9. The method of claim 1, further comprising:displaying, at the smart mirror of the user during the second timeperiod, a graphic representation of a performance of the user during thesecond time period relative to the performance score of the user duringthe first time period, the graphic having at least one of a color or adimension indicative of the performance of the user during the secondtime period.
 10. The method of claim 1, further comprising: determining,based on at least one of (1) live video of the user during the secondtime period, (2) recorded video of the user during the second timeperiod, or (3) biometric data associated with the user during the secondtime period, a performance score of the user during the second timeperiod; and displaying, at the smart mirror of the user during thesecond time period, a representation of the performance score of theuser during the second time period.
 11. An apparatus, comprising: asmart mirror including a first processor and a memory, the memoryoperably coupled to the first processor and storing processor-executableinstructions to: receive, from a compute device of a user and via awireless telecommunications network, a signal representing a selectionof a workout that is associated with a previously-recorded video file(1) representing a previously-recorded video of the user performing theworkout during a first time period, and (2) including a performancescore of the user during the first time period, the compute device ofthe user including a second processor different from the firstprocessor; and cause display, via the smart mirror and during a secondtime period after the first time period, of the previously-recordedvideo, in response to the selection while the smart mirror of the userreflects an image of the user performing the workout.
 12. The apparatusof claim 11, wherein the processor-executable instructions furtherinclude processor-executable instructions to: cause display, via thesmart mirror and during the second time period, of a representation of aperformance score of the user during the second time period and arepresentation of the performance score of the user during the firsttime period.
 13. The apparatus of claim 11, wherein theprocessor-executable instructions further include processor-executableinstructions to: cause display, via the smart mirror and during thesecond time period, of a numeric representation of the performance scoreof the user during the first time period and a numeric representation ofa performance score of the user during the second time period.
 14. Theapparatus of claim 11, wherein the processor-executable instructionsfurther include processor-executable instructions to: cause display, viathe smart mirror and during the second time period, of a numericrepresentation of a difference between the performance score of the userduring the first time period and a performance score of the user duringthe second time period.
 15. The apparatus of claim 11, wherein theprocessor-executable instructions further include processor-executableinstructions to: cause display, via the smart mirror and during thesecond time period, of a non-numeric representation of a differencebetween the performance score of the user during the first time periodand a performance score of the user during the second time period. 16.The apparatus of claim 11, wherein the processor-executable instructionsfurther include processor-executable instructions to: cause display, viathe smart mirror and during the second time period, of live video of theuser performing the workout.
 17. The apparatus of claim 11, wherein theprocessor-executable instructions further include processor-executableinstructions to: cause display, via the smart mirror and during thesecond time period, of a graphic representation of a performance of theuser during the second time period relative to the performance score ofthe user during the first time period.
 18. The apparatus of claim 11,wherein the processor-executable instructions further includeprocessor-executable instructions to: cause display, via the smartmirror and during the second time period, of a graphic representation ofa performance of the user during the second time period relative to theperformance score of the user during the first time period, the graphicrepresentation having at least one of a color or a dimension indicativeof the performance of the user during the second time period.
 19. Theapparatus of claim 11, wherein the processor-executable instructionsfurther include processor-executable instructions to: determine, basedon at least one of (1) live video of the user during the second timeperiod, (2) recorded video of the user during the second time period, or(3) biometric data associated with the user during the second timeperiod, a performance score of the user during the second time period;and cause display, via the smart mirror and during the second timeperiod, of a representation of the performance score of the user duringthe second time period.
 20. The method of claim 1, wherein theperformance score of the user during the first time period is includedin the previously-recorded video file as metadata of thepreviously-recorded video file.
 21. The method of claim 1, furthercomprising displaying, at the smart mirror of the user and during thesecond time period, live video of the user, the live video beingobtained via at least one video camera of the smart mirror of the user.